Maxent Queries and Sequential Sampling
نویسنده
چکیده
In this paper we pose the question: After gathering N data points, at what value of the control parameter should the next measurement be done? We propose an on-line algorithm which samples optimally by maximizing the gain in information on the parameters to be measured. We show analytically that the information gain is maximum for those potential measurements whose outcome is most unpredictable, i.e. for which the predictive distribution has maximum entropy. The resulting algorithm is applied to exponential analysis.
منابع مشابه
Nonuniform sampling and maximum entropy reconstruction applied to the accurate measurement of residual dipolar couplings.
Residual dipolar couplings (RDC) provide important global restraints for accurate structure determination by NMR. We show that nonuniform sampling in combination with maximum entropy reconstruction (MaxEnt) is a promising strategy for accelerating and potentially enhancing the acquisition of RDC spectra. Using MaxEnt-processed spectra of nonuniformly sampled data sets that are reduced up to one...
متن کاملMaximum Entropy and Maximum Probability
Sanov’s Theorem and the Conditional Limit Theorem (CoLT) are established for a multicolor Pólya Eggenberger urn sampling scheme, giving the Pólya divergence and the Pólya extension to the Maximum Relative Entropy (MaxEnt) method. Pólya MaxEnt includes the standard MaxEnt as a special case. The universality of standard MaxEnt advocated by an axiomatic approach to inference for inverse problems i...
متن کاملMaxEnt versus MaxLike: empirical comparisons with ant species distributions
MaxEnt is one of the most widely used tools in ecology, biogeography, and evolution for modeling and mapping species distributions using presence-only occurrence records and associated environmental covariates. Despite its popularity, the exponential model implemented by MaxEnt does not directly estimate occurrence probability, the natural quantity of interest when modeling species distribution...
متن کاملOn Tsallis Entropy Bias and Generalized Maximum Entropy Models
In density estimation task, maximum entropy model (Maxent) can effectively use reliable prior information via certain constraints, i.e., linear constraints without empirical parameters. However, reliable prior information is often insufficient, and the selection of uncertain constraints becomes necessary but poses considerable implementation complexity. Improper setting of uncertain constraints...
متن کاملProbabilistic Knowledge Representation Using Gröbner Basis Theory
An often used methodology for reasoning with probabilistic conditional knowledge bases is provided by the principle of maximum entropy (so-called MaxEnt principle) that realises an idea of informational economy. In this paper we exploit the fact that MaxEnt distributions can be computed by solving nonlinear equation systems that reflect the conditional logical structure of these distributions. ...
متن کامل